Systems and methods for generating panning images

ABSTRACT

Images may be captured by a moving image capture device. A reference image and a background image may be selected from the images. The reference image may include depiction of an object, with the object blocking view of the background. The background image may include depiction of the background blocked by the object in the reference image. An object layer may be generated by segmenting the depiction of the object from the reference image. A background layer may be generated by combining the depiction of the background in the background image with the reference image. The background layer may be blurred and combined with the object layer to generate a panning image.

FIELD

This disclosure relates to generating panning images using imagescaptured by a moving image capture device and image stabilization.

BACKGROUND

A panning blur effect may be created by panning a camera during captureto follow a subject. The panning blur effect provide a dramatic look forthe subject by blurring the background while freezing the action on thesubject. However, keeping the camera precisely directed at the subjectis difficult, and the panning blur effect may also include the subjectbeing blurred. A video may include greater visual capture of one or morescenes, objects, and/or activities than may be viewed at a time.Determining which portion(s) of the video should be presented duringplayback may be difficult and time consuming.

SUMMARY

This disclosure relates to generating panning images. Visualinformation, motion information, and/or other information may beobtained. The visual information may define visual content of imagescaptured by an image capture device while experiencing motion. Themotion information may characterize the motion experienced by the imagecapture device during capture of the images. A reference image may beselected from the images. The visual content of the reference image mayhave a first field of view of a scene including an object of interest.The visual content of the reference image may include a depiction of theobject of interest located at a first extent of the first field of view.A background image may be selected from the images. The background imagemay be different from the reference image. The visual content of thebackground image may have a second field of view of the scene. Thesecond field of view of the scene may be different from the first fieldof view based on the motion experienced by the image capture devicebetween capture of the reference image and the background image.

The reference image and the background image may be stabilized based onthe motion experienced by the image capture device between capture ofthe reference image and the background image and/or other information.The reference image and the background image may be stabilized such thatoverlapping portions of the first field of view and the second field ofview are aligned and a second extent of the second field of view thatoverlaps with the first extent of the first field of view includes adepiction of background. An object layer may be generated. The objectlayer may include the depiction of the object of interest based onsegmentation of the depiction of the object of interest from the visualcontent of the reference image. A background layer may be generatedbased on combination of the depiction of the background within thevisual content of the background image with the visual content of thereference image such that the depiction of the object of interest isreduced in the background layer. The background layer may be blurred. Apanning image may be generated based on combination of the object layerand the blurred background layer.

A system that generates panning images may include one or moreelectronic storages, one or more processors, and/or other components. Anelectronic storage may store visual information, information relating tovisual content, information relating to image capture device, motioninformation, information relating to motion experienced by the imagecapture device, information relating to reference image, informationrelating to field of view of scene, information relating to object ofinterest, information relating to depiction of object of interest,information relating to background image, information relating tooverlapping portions of fields of view of reference image and backgroundimage, information relating to depiction of background, informationrelating to object layer, information relating to background layer,information relating to blurring, information relating to panning image,and/or other information. In some implementations, the system mayinclude one or more optical elements, one or more image sensors, one ormore motion sensors, and/or other components.

One or more components of the system may be carried by a housing, suchas a housing of an image capture device. For example, the opticalelement(s), the image sensor(s), and/or the motion sensor(s) of thesystem may be carried by the housing of an image capture device. Thehousing may carry other components, such as the processor(s) and/or theelectronic storage.

The processor(s) may be configured by machine-readable instructions.Executing the machine-readable instructions may cause the processor(s)to facilitate generating panning images. The machine-readableinstructions may include one or more computer program components. Thecomputer program components may include one or more of a visualinformation component, a motion information component, a reference imagecomponent, a background image component, an object layer component, abackground layer component, a blur component, a panning image component,and/or other computer program components.

The visual information component may be configured to obtain visualinformation and/or other information. The visual information may definevisual content of images. The images may have been captured by an imagecapture device while experiencing motion.

The motion information component may be configured to obtain motioninformation and/or other information. The motion information maycharacterize the motion experienced by the image capture device duringcapture of the images. In some implementations, the motion experiencedby the image capture device may include rotation of the image capturedevice to follow motion of an object of interest.

The reference image component may be configured to select a referenceimage and/or other image from the images. The visual content of thereference image may have a first field of view of a scene including anobject of interest. The visual content of the reference image mayinclude a depiction of the object of interest located at a first extentof the first field of view.

The background image component may be configured to select a backgroundimage and/or other image from the images. The background image may bedifferent from the reference image. The background image may include oneof the images captured before or after the reference image. The visualcontent of the background image may have a second field of view of thescene. The second field of view of the scene may be different from thefirst field of view based on the motion experienced by the image capturedevice between capture of the reference image and the background image.The reference image and the background image may be stabilized based onthe motion experienced by the image capture device between capture ofthe reference image and the background image and/or other information.The reference image and the background image may be stabilized such thatoverlapping portions of the first field of view and the second field ofview are aligned. The reference image and the background image may bestabilized such that a second extent of the second field of viewoverlapping with the first extent of the first field of view includes adepiction of background.

The object layer component may be configured to generate an object layerand/or other layers. The object layer may be generated to include thedepiction of the object of interest based on segmentation of thedepiction of the object of interest from the visual content of thereference image.

The background layer component may be configured to generate abackground layer and/or other layers. The background layer may begenerated based on combination of the depiction of the background withinthe visual content of the background image with the visual content ofthe reference image. The background layer may be generated such that thedepiction of the object of interest is reduced in the background layer.

In some implementations, the depiction of the object of interest may bereduced by merging the depiction of the background with the depiction ofthe object of interest. In some implementations, the depiction of theobject of interest may be reduced by replacing the depiction of theobject of interest with the depiction of the background.

The blur component may be configured to blur the background layer and/orother layers. In some implementations, the background layer may beblurred based on the motion experienced by the image capture devicebetween capture of the reference image and the background image and/orother information. In some implementations, blurring of the backgroundlayer based on the motion experienced by the image capture devicebetween capture of the reference image and the background image mayinclude: computing one or more directional blur kernels that follow themotion experienced by the image capture device between capture of thereference image and the background image; and applying the directionalblur kernel(s) to the background layer. In some implementations,strength with which the background layer is blurred may be determinedbased on the motion experienced by the image capture device betweencapture of the reference image and the background image and/or otherinformation. In some implementations, strength and/or direction in whichthe background layer is blurred may adjusted based on user input and/orother information.

The panning image component may be configured to generate a panningimage based on combination of the object layer, the blurred backgroundlayer, and/or other layers. In some implementations, generating thepanning image based on the combination of the object layer and theblurred background layer may include: blurring edge of the depiction ofthe object of interest within the object layer; and blending the blurrededge of the depiction of the object of interest within the object layerwith the background layer.

These and other objects, features, and characteristics of the systemand/or method disclosed herein, as well as the methods of operation andfunctions of the related elements of structure and the combination ofparts and economies of manufacture, will become more apparent uponconsideration of the following description and the appended claims withreference to the accompanying drawings, all of which form a part of thisspecification, wherein like reference numerals designate correspondingparts in the various figures. It is to be expressly understood, however,that the drawings are for the purpose of illustration and descriptiononly and are not intended as a definition of the limits of theinvention. As used in the specification and in the claims, the singularform of “a,” “an,” and “the” include plural referents unless the contextclearly dictates otherwise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example system that generates panning images.

FIG. 2 illustrates an example method for generating panning images.

FIG. 3 illustrates an example image capture device.

FIG. 4 illustrates example motion of an image capture device.

FIG. 5 illustrates an example panning image.

FIG. 6 illustrates an example reference image and an example backgroundimage.

FIG. 7 illustrates example placement of viewing window forstabilization.

FIG. 8 illustrates an example object mask.

FIG. 9 illustrates an example background layer and an example blurredbackground layer.

FIG. 10 illustrates an example panning image.

FIG. 11 illustrates an example panning image.

DETAILED DESCRIPTION

FIG. 1 illustrates a system 10 for generating panning images. The system10 may include one or more of a processor 11, an interface 12 (e.g.,bus, wireless interface), an electronic storage 13, and/or othercomponents. In some implementations, the system 10 may include one ormore optical elements, one or more image sensors, one or more motionsensors, and/or other components. Visual information, motioninformation, and/or other information may be obtained by the processor11. The visual information may define visual content of images capturedby an image capture device while experiencing motion. The motioninformation may characterize the motion experienced by the image capturedevice during capture of the images. A reference image may be selectedfrom the images by the processor 11. The visual content of the referenceimage may have a first field of view of a scene including an object ofinterest. The visual content of the reference image may include adepiction of the object of interest located at a first extent of thefirst field of view. A background image may be selected from the imagesby the processor 11. The background image may be different from thereference image. The visual content of the background image may have asecond field of view of the scene. The second field of view of the scenemay be different from the first field of view based on the motionexperienced by the image capture device between capture of the referenceimage and the background image.

The reference image and the background image may be stabilized based onthe motion experienced by the image capture device between capture ofthe reference image and the background image and/or other information.The reference image and the background image may be stabilized such thatoverlapping portions of the first field of view and the second field ofview are aligned and a second extent of the second field of view thatoverlaps with the first extent of the first field of view includes adepiction of background. An object layer may be generated by theprocessor 11. The object layer may include the depiction of the objectof interest based on segmentation of the depiction of the object ofinterest from the visual content of the reference image. A backgroundlayer may be generated by the processor 11 based on combination of thedepiction of the background within the visual content of the backgroundimage with the visual content of the reference image such that thedepiction of the object of interest is reduced in the background layer.The background layer may be blurred by the processor 11. A panning imagemay be generated by the processor 11 based on combination of the objectlayer and the blurred background layer.

The electronic storage 13 may be configured to include electronicstorage medium that electronically stores information. The electronicstorage 13 may store software algorithms, information determined by theprocessor 11, information received remotely, and/or other informationthat enables the system 10 to function properly. For example, theelectronic storage 13 may store visual information, information relatingto visual content, information relating to image capture device, motioninformation, information relating to motion experienced by the imagecapture device, information relating to reference image, informationrelating to field of view of scene, information relating to object ofinterest, information relating to depiction of object of interest,information relating to background image, information relating tooverlapping portions of fields of view of reference image and backgroundimage, information relating to depiction of background, informationrelating to object layer, information relating to background layer,information relating to blurring, information relating to panning image,and/or other information

Visual content may refer to content of image(s), video frame(s), and/orvideo(s) that may be consumed visually. For example, visual content maybe included within one or more images and/or one or more video frames ofa video. The video frame(s) may define/contain the visual content of thevideo. That is, video may include video frame(s) that define/contain thevisual content of the video. Video frame(s) may define/contain visualcontent viewable as a function of progress through the progress lengthof the video content. A video frame may include an image of the videocontent at a moment within the progress length of the video. As usedherein, the term video frame may be used to refer to one or more of animage frame, frame of pixels, encoded frame (e.g., I-frame, P-frame,B-frame), and/or other types of video frame. Visual content may begenerated based on light received within a field of view of a singleimage sensor or within fields of view of multiple image sensors.

Visual content (of image(s), of video frame(s), of video(s)) with afield of view may be captured by an image capture device during acapture duration. A field of view of visual content may define a fieldof view of a scene captured within the visual content. A captureduration may be measured/defined in terms of time durations and/or framenumbers. For example, visual content may be captured during a captureduration of 60 seconds, and/or from one point in time to another pointin time. As another example, 1800 images may be captured during acapture duration. If the images are captured at 30 images/second, thenthe capture duration may correspond to 60 seconds. Other capturedurations are contemplated.

Visual content may be stored in one or more formats and/or one or morecontainers. A format may refer to one or more ways in which theinformation defining visual content is arranged/laid out (e.g., fileformat). A container may refer to one or more ways in which informationdefining visual content is arranged/laid out in association with otherinformation (e.g., wrapper format). Information defining visual content(visual information) may be stored within a single file or multiplefiles. For example, visual information defining an image or video framesof a video may be stored within a single file (e.g., image file, videofile), multiple files (e.g., multiple image files, multiple videofiles), a combination of different files, and/or other files.

The system 10 may be remote from the image capture device or local tothe image capture device. One or more portions of the image capturedevice may be remote from or a part of the system 10. One or moreportions of the system 10 may be remote from or a part of the imagecapture device. For example, one or more components of the system 10 maybe carried by a housing, such as a housing of an image capture device.For instance, optical element(s), image sensor(s), and/or motionsensor(s) of the system 10 may be carried by the housing of the imagecapture device. The housing may carry other components, such as theprocessor 11 and/or the electronic storage 13. References to a housingof an image capture device may refer to the image capture device, andvice versa.

An image capture device may refer to a device captures visual content.An image capture device may capture visual content in form of images,videos, and/or other forms. An image capture device may refer to adevice for recording visual information in the form of images, videos,and/or other media. An image capture device may be a standalone device(e.g., camera, action camera, image sensor) or may be part of anotherdevice (e.g., part of a smartphone, tablet). FIG. 3 illustrates anexample image capture device 302. Visual content (e.g., of image(s),video frame(s)) may be captured by the image capture device 302. Theimage capture device 302 may include a housing 312. The housing 312 mayrefer a device (e.g., casing, shell) that covers, protects, and/orsupports one or more components of the image capture device 302. Thehousing 312 may include a single-piece housing or a multi-piece housing.The housing 312 may carry (be attached to, support, hold, and/orotherwise carry) one or more of an optical element 304, an image sensor306, a motion sensor 308, a processor 310, and/or other components.

One or more components of the image capture device 302 may be the sameas, be similar to, and/or correspond to one or more components of thesystem 10. For example, the processor 308 may be the same as, be similarto, and/or correspond to the processor 11. The housing may carry othercomponents, such as the electronic storage 13. The image capture device302 may include other components not shown in FIG. 3. The image capturedevice 302 may not include one or more components shown in FIG. 3. Otherconfigurations of image capture devices are contemplated.

The optical element 304 may include instrument(s), tool(s), and/ormedium that acts upon light passing through theinstrument(s)/tool(s)/medium. For example, the optical element 304 mayinclude one or more of lens, mirror, prism, and/or other opticalelements. The optical element 304 may affect direction, deviation,and/or path of the light passing through the optical element 304. Theoptical element 304 may have a field of view 305. The optical element304 may be configured to guide light within the field of view 305 to theimage sensor 306.

The field of view 305 may include the field of view of a scene that iswithin the field of view of the optical element 304 and/or the field ofview of the scene that is delivered to the image sensor 306. Forexample, the optical element 304 may guide light within its field ofview to the image sensor 306 or may guide light within a portion of itsfield of view to the image sensor 306. The field of view of 305 of theoptical element 304 may refer to the extent of the observable world thatis seen through the optical element 304. The field of view 305 of theoptical element 304 may include one or more angles (e.g., verticalangle, horizontal angle, diagonal angle) at which light is received andpassed on by the optical element 304 to the image sensor 306. In someimplementations, the field of view 305 may be greater than 180-degrees.In some implementations, the field of view 305 may be less than180-degrees. In some implementations, the field of view 305 may be equalto 180-degrees.

In some implementations, the image capture device 302 may includemultiple optical elements. For example, the image capture device 302 mayinclude multiple optical elements that are arranged on the housing 312to capture spherical images/videos (guide light within spherical fieldof view to one or more images sensors). For instance, the image capturedevice 302 may include two optical elements positioned on opposing sidesof the housing 312. The fields of views of the optical elements mayoverlap and enable capture of spherical images and/or spherical videos.

The image sensor 306 may include sensor(s) that converts received lightinto output signals. The output signals may include electrical signals.The image sensor 306 may generate output signals conveying informationthat defines visual content of one or more images and/or one or morevideo frames of a video. For example, the image sensor 306 may includeone or more of a charge-coupled device sensor, an active pixel sensor, acomplementary metal-oxide semiconductor sensor, an N-typemetal-oxide-semiconductor sensor, and/or other image sensors.

The image sensor 306 may be configured generate output signals conveyinginformation that defines visual content of one or more images and/or oneor more video frames of a video. The image sensor 306 may be configuredto generate a visual output signal based on light that becomes incidentthereon during a capture duration and/or other information. The visualoutput signal may convey visual information that defines visual contenthaving the field of view. The optical element 304 may be configured toguide light within the field of view 305 to the image sensor 306, andthe image sensor 306 may be configured to generate visual output signalsconveying visual information based on light that becomes incidentthereon via the optical element 304.

The visual information may define visual content by includinginformation that defines one or more content, qualities, attributes,features, and/or other aspects of the visual content. For example, thevisual information may define visual content of an image by includinginformation that makes up the content of the image, and/or informationthat is used to determine the content of the image. For instance, thevisual information may include information that makes up and/or is usedto determine the arrangement of pixels, characteristics of pixels,values of pixels, and/or other aspects of pixels that define visualcontent of the image. For example, the visual information may includeinformation that makes up and/or is used to determine pixels of theimage. Other types of visual information are contemplated.

Capture of visual content by the image sensor 306 may include conversionof light received by the image sensor 306 into output signals/visualinformation defining visual content. Capturing visual content mayinclude recording, storing, and/or otherwise capturing the visualcontent for use in generating video content (e.g., content of videoframes). For example, during a capture duration, the visual outputsignal generated by the image sensor 306 and/or the visual informationconveyed by the visual output signal may be used to record, store,and/or otherwise capture the visual content for use in generating videocontent.

In some implementations, the image capture device 302 may includemultiple image sensors. For example, the image capture device 302 mayinclude multiple image sensors carried by the housing 312 to capturespherical images/videos based on light guided thereto by multipleoptical elements. For instance, the image capture device 302 may includetwo image sensors configured to receive light from two optical elementspositioned on opposing sides of the housing 312. The fields of views ofthe optical elements may overlap and enable capture of spherical imagesand/or spherical videos.

The motion sensor 308 may include sensor(s) that measures experiencedpositions and/or motions. Positions may include rotational positions(orientations) and/or translational positions. Motions may includerotational motions (changes in orientation, tilt, pitch, roll) and/ortranslational motions (e.g., forward/backward motion, left/right motion,up/down motion). The motion sensor 308 may convert experienced positionsand/or motions into output signals. The output signals may includeelectrical signals. For example, the motion sensor 308 may refer to aset of motion sensors, which may include one or more inertialmeasurement units, one or more accelerometers, one or more gyroscopes,and/or other motion sensors. The motion sensor 308 may generate outputsignals conveying information that characterizes positions and/ormotions of the motion sensor 308 and/or device(s) carrying the motionsensor 308, such as the image capture device 302 and/or the housing 312.

For example, the motion sensor 308 may be configured to generate amotion output signal based on positions/motion of the image capturedevice 302 during the capture duration. The motion output signal mayconvey motion information that characterizes motion experienced by theimage capture device 302 at different moments (points in time, timedurations) within the capture duration. For example, the motioninformation that characterizes motion experienced by the image capturedevice 302 during capture of images by the image capture device 302.

The motion information may characterize motion experienced by the imagecapture device 302 based on specific translational and/or rotationalpositions of the image capture device 302 and/or based on changes intranslational and/or rotational positions of the image capture device302 as a function of progress through the capture duration. That is, themotion information may characterize translational and/or rotationalpositions of the image capture device 302 and/or changes intranslational and/or rotational positions of the image capture device302 (e.g., direction, amount, velocity, acceleration) during the captureduration. The motion information may include rotational motioninformation characterizing rotational motion of the image capture device302, translational motion information characterizing translationalmotion of the image capture device 302, and/or other motion information.

In some implementations, the motion information may include data fromthe motion sensor (e.g., gyroscope data, accelerometer data) with timestamps per visual content capture at different moments. For example, themotion information may include gyroscope data and/or accelerometer dataper individual images/video frames captured by the image capture device.In some implementations, calibration of an inertial measurement unit maybe used to combine different data within the motion information.

The processor 310 may include one or more processors (logic circuitry)that provide information processing capabilities in the image capturedevice 302. The processor 310 may provide one or more computingfunctions for the image capture device 302. The processor 310 mayoperate/send command signals to one or more components of the imagecapture device 302 to operate the image capture device 302. For example,the processor 310 may facilitate operation of the image capture device302 in capturing image(s) and/or video(s), facilitate operation of theoptical element 304 (e.g., change how light is guided by the opticalelement 304), and/or facilitate operation of the image sensor 306 (e.g.,change how the received light is converted into information that definesimages/videos and/or how the images/videos are post-processed aftercapture).

The processor 310 may obtain information from the image sensor 306and/or the motion sensor 308, and/or facilitate transfer of informationfrom the image sensor 306 and/or the motion sensor 308 to anotherdevice/component. The processor 310 may be remote from the processor 11or local to the processor 11. One or more portions of the processor 310may be remote from the processor 11 and/or one or more portions of theprocessor 10 may be part of the processor 310. The processor 310 mayinclude and/or perform one or more functionalities of the processor 11shown in FIG. 1.

The image capture device 302 may capture visual content of images whileexperiencing motion. FIG. 4 illustrates example motion of an imagecapture device 402. For example, the image capture device 402 mayexperience rotation 404 during while it is capturing visual content of apanning image. The image capture device 402 may be rotated during anexposure of the image sensor to capture the visual content of thepanning image. The image capture device 402 may be rotated to keep thesubject of the panning image centered within the field of view of theimage sensor. Such rotation of the image capture device 402 whileexposing the image sensor to light may generate an image that blurs thebackground.

However, change in posture of the subject during the exposure and/orimprecise tracking of the subject with the image capture device 402 mayresult in blurring of the subject. For example, FIG. 5 illustrates anexample panning image 500 captured by rotating an image capture deviceduring exposure of the image sensor. The panning image 500 may includedepiction of a person moving from right to left. The image capturedevice may have been rotated during exposure of the image sensor totrack the person's movement and capture the panning image 500 withblurred background. However, the person's posture may have changedduring the exposure and/or the tracking of the person may have beenimprecise, resulting in the person being blurred within the panningimage 500.

Instead of generating a panning image from visual content captured by amoving image capture device in a single exposure duration, a panningimage may be generated by using multiple images (captured using shorterexposure duration to reduce/eliminate motion blur) captured during themotion of the image capture device. For example, the image capturedevice may be used to capture visual content of multiple images whilethe image capture device is experiencing motion (e.g., rotational motionto track a subject). One of the captured images may be selected as areference image, and another one of the captured images may be selectedas a background image. The reference image and the background image maybe stabilized based on the motion of the image capture device. Aparticular extent of the reference image may depict an object ofinterest. The same extent of the background image may depict thebackground (e.g., scene). An object layer may be generated by segmentingthe depiction of the object from the reference image. A background layermay be generated by using the depiction of the background within thebackground image to reduce the depiction of the object of interestwithin the background layer. The background layer may be blurred, and apanning image may be generated by combining the object layer with theblurred background layer. Such generation of the panning image may beperformed by the image capture device and/or a computing device remotefrom the image capture device (e.g., during post processing).

Referring back to FIG. 1, the processor 11 may be configured to provideinformation processing capabilities in the system 10. As such, theprocessor 11 may comprise one or more of a digital processor, an analogprocessor, a digital circuit designed to process information, a centralprocessing unit, a graphics processing unit, a microcontroller, ananalog circuit designed to process information, a state machine, and/orother mechanisms for electronically processing information. Theprocessor 11 may be configured to execute one or more machine-readableinstructions 100 to facilitate generating panning images. Themachine-readable instructions 100 may include one or more computerprogram components. The machine-readable instructions 100 may includeone or more of a visual information component 102, a motion informationcomponent 104, a reference image component 106, a background imagecomponent 108, an object layer component 110, a background layercomponent 112, a blur component 114, a panning image component 116,and/or other computer program components.

The visual information component 102 may be configured to obtain visualinformation and/or other information. Obtaining visual information mayinclude one or more of accessing, acquiring, analyzing, determining,examining, identifying, loading, locating, opening, receiving,retrieving, reviewing, selecting, storing, and/or otherwise obtainingthe visual information. The visual information component 102 may obtainvisual information from one or more locations. For example, the visualinformation component 102 may obtain visual information from a storagelocation, such as the electronic storage 13, electronic storage ofinformation and/or signals generated by one or more sensors, electronicstorage of a device accessible via a network, and/or other locations.The visual information component 102 may obtain information from one ormore hardware components (e.g., an image sensor) and/or one or moresoftware components (e.g., software running on a computing device).

Visual information may be obtained during capture of the visual contentand/or after acquisition of the visual content by an image capturedevice/image sensor. For example, the visual information component 102may obtain visual information defining visual content while/as thevisual content is captured by an image capture device. The visualinformation component 102 may obtain visual information defining visualcontent after the visual content has been captured and stored in memory(e.g., the electronic storage 13).

In some implementations, the visual information component 102 may obtainvisual information based on user interaction with a userinterface/application (e.g., video editing application, video playerapplication), and/or other information. For example, a userinterface/application may provide option(s) for a user to select visualcontent from which a panning image is to be generated. The visualinformation defining the visual content may be obtained based on theuser's selection of the visual content through the user interface/videoapplication. Other selections of visual content for retrieval of visualinformation are contemplated.

The visual information may define visual content of multiple images. Themultiple images may have been captured by an image capture device whileexperiencing motion. The multiple images may have been captured by animage capture device from different translational positions and/ordifferent rotational positions. For example, the visual information maydefine visual content of separate images captured by the image capturedevice 402 while undergoing rotation 404, as shown in FIG. 4. As anotherexample, the visual information may define visual content of separateimages captured by the image capture device 402 while being held byshaky hand(s).

The motion information component 104 may be configured to obtain motioninformation and/or other information. Obtaining motion information mayinclude one or more of accessing, acquiring, analyzing, determining,examining, identifying, loading, locating, opening, receiving,retrieving, reviewing, selecting, storing, and/or otherwise obtainingthe motion information. The motion information component 104 may obtainmotion information from one or more locations. For example, the motioninformation component 104 may obtain motion information from a storagelocation, such as the electronic storage 13, electronic storage ofinformation and/or signals generated by one or more sensors, electronicstorage of a device accessible via a network, and/or other locations.The motion information component 104 may obtain motion information fromone or more hardware components (e.g., a motion sensor, a hardwarecomponent of an image capture device) and/or one or more softwarecomponents (e.g., software running on a computing device).

The motion information component 102 may be configured to obtain motioninformation of the image capture device during acquisition of the imagesand/or after acquisition of images by the image capture device. Forexample, the motion information component 104 may obtain motioninformation of the image capture device while images are being captured.The motion information component 104 may obtain motion information ofthe image capture device after images have been captured and stored inmemory (e.g., the electronic storage 13). For example, the motioninformation may be captured and stored by one or more motion sensors,and may be obtained by the motion information component 104 when panningimage is to be generated.

The motion information may characterize the motion experienced by theimage capture device during capture of the images. The motionexperienced by the image capture device may include translational motionand/or rotational motion. For example, the motion experienced by theimage capture device during capture of images may include rotation ofthe image capture device to follow the motion of an object of interest.For example, the motion information may characterize the rotation 404experienced by the image capture device 402 during capture of images, asshown in FIG. 4. The image capture device 402 may have been rotated totrack the motion of an object of interest. For instance, the imagecapture device 402 may have been rotated to keep the of interestcentered within the field of view of the image capture device 402. Asanother example, the motion information may characterize rotationexperienced by the image capture device due to shaking of hand(s)holding the image capture device.

Motion of an image capture device may refer to how the image capturedevice moves/changes in position rotationally and/or translationally.For example, rotational motion of an image capture device may refer tohow the image capture device is oriented/rotated around one or more axisor one or more point, such as a center point. For instance, rotationalmotion of an image capture device may refer to how the image capturedevice is rotated about one or more of yaw axis, pitch axis, and/or rollaxis. Motion information of an image capture device may characterize howthe image capture device is rotated (e.g., amount of rotations about theyaw, pitch, and/or roll axis) and/or is being rotated (e.g., speedand/or direction of rotations) at different moments within the captureduration. In some implementation, the motion of the image capture devicemay include intentional motion to track an object within the field ofview of the image capture device. In some implementation, motion of theimage capture device may include unintentional motion of the imagecapture device (e.g., motion due to shaky hand(s) holding the imagecapture device).

Different positions (e.g., translational position, rotational position)of the image capture device during capture of multiple images may resultin the visual content of images depicting different views of the scene.Different positions (e.g., translational position, rotational position)of the image capture device during capture of multiple images may resultin the visual content of images depicting different parts of the scene.For example, rotation of the image capture device during capture ofmultiple images may result in different images including depiction ofdifferent portions of the scene (e.g., background). Movement of theobject of interest during capture of the image may result in the objectof interest blocking different portions of the scene within differentimages.

The reference image component 106 may be configured to select areference image and/or other image from the images. In someimplementations, the reference image may be selected based on analysisof the images, information associated with the images (e.g., metadata),and/or other information. For example, the visual content of the imagesmay be analyzed to identify the image that includes a particulardepiction of the object of interest. An object of interest may refer toa living or non-living thing that is of interest to a user. An object ofinterest may refer to a thing that is to be the subject of the panningimage. For example, an image may be selected as a reference image basedon the image depicting the object in a particular action (e.g., jumping,falling), the image depicting the object in a particular posture, theimage depicting the object showing particular emotion, the imagedepicting the object with certain amount of clarity (e.g., no motionblur), and/or based on other type of depiction of the object within theimage.

In some implementations, the reference image may be selected based onuser selection, and/or other information. For example, the images may bepresented to a user within a graphical user interface, and the user mayinteract with the graphical user interface to select an image to be usedas the reference image. Other selections of reference image arecontemplated.

The visual content of the reference image may have a field of view of ascene including an object of interest. The visual content of thereference image may include a depiction of the object of interestlocated at a particular extent of the field of view. For example, FIG. 6illustrates an example reference image 610. The reference image 610 mayinclude depiction of a field of view of a scene including the ground,buildings, and a person on a skateboard. The object of interest may bethe person on the skateboard. The visual content of the reference image710 may include the depiction of the person on the skateboard at acenter extent of the field of view.

The background image component 108 may be configured to select abackground image and/or other image from the images. The backgroundimage may be different from the reference image. That is, the backgroundimage component 108 may select one of the images not selected as thereference image as the background image. The background image mayinclude one of the images captured before or after the reference image.

In some implementations, the background image may be selected based onanalysis of the images, information associated with the images (e.g.,metadata), and/or other information. For example, the visual content ofthe images may be analyzed to identify the image that includes differentdepiction of the object of interest and/or different depiction of thebackground from the reference image. For instance, an image may beselected as a background image based on the image depicting a portion ofthe scene that was covered by the object of interest in the referenceimage. That is, the reference image may include a depiction of theobject of interest blocking the view of a particular portion of thescene/background. An image may be selected as the background image basedon the image including depiction of the portion of the scene/backgroundthat was blocked by the object of interest in the reference image.

In some implementations, the background image may be selected based onuser selection, and/or other information. For example, the images may bepresented to a user within a graphical user interface, and the user mayinteract with the graphical user interface to select an image to be usedas the background image. Other selections of background image arecontemplated.

The visual content of the background image may have a field of view ofthe scene. The field of view of the scene within the background imagemay be different from the field of view of the scene within thereference image. The reference image and the background image mayinclude different field of view of the scene based on the motionexperienced by the image capture device between capture of the referenceimage and the background image. For example, based on the image capturedevice being rotated from left to right between capture of the referenceimage and the background image, the reference image and the backgroundimage may depict different portions of the scene.

The reference image and the background image may be stabilized based onthe motion experienced by the image capture device between capture ofthe reference image and the background image and/or other information.Stabilization of the reference image and the background image mayinclude alignment of the reference image and the background image sothat the portions of the images depicting the same portion of the sceneare aligned. Stabilization of the reference image and the backgroundimage may include alignment of the reference image and the backgroundimage so that the reference image and the background image appear tohave been captured from the same position (without motion betweencapture of the reference image and the background image).

In some implementations, stabilization of the reference image and thebackground image may be performed based on punchout of the referenceimage and the background image. Rather than using the entire visualcontent captured by the image capture device, one or more portions ofthe visual content may be punched out (using a viewing window) toprovide stabilization. Stabilization of visual content of the referenceimage and the background image may be performed based on placement ofthe viewing window within the field of views of the captured visualcontent. Stabilization of visual content may include using smallerspatial extents of the captured visual content to provide a punchoutview of the visual content that creates a more stable view than whenviewing the entirety of the captured visual content.

A punchout of the visual content may refer to an output of one or moreportions of the visual content. A punchout of the visual content mayrefer to extents of the visual content that is obtained for viewingand/or extraction. The extents of the visual content viewable/extractedwithin the viewing window may be used to provide views of differentspatial extents of the visual content. Inclusion of the extent(s) of thevisual content within the punchout/viewing window may effectuatestabilization of the visual content via selective cropping.

FIG. 7 illustrates example placement of viewing window forstabilization. A reference image 710 may have a field of view 712, and abackground image 720 may have a field of view 722. A viewing window 714,having a punchout field of view 716, may be placed within the field ofview 712 of the reference image. A viewing window 724 (having the samefield of view as the viewing window 714) may be placed within the fieldof view 722 of the background image. The viewing windows 714, 724 mayprovide a punchout of the images 710, 720 to be used for stabilization.Placements of the viewing window 714, 724 within the fields of view 712,722 may be changed to perform stabilization. For example, the viewingwindow 714 may be placed in the center of the field of view 712 of thereference image 710. The viewing window 724 may be laterally moved withrespect to the field of view 722 of the background image 720. Theplacements of the viewing window 714, 724 may be determined based on themotion of the image capture device between capture of the referenceimage 710 and the background image 720. The placements of the viewingwindow 714, 724 may be determined based on the positions of the imagecapture device when the images 710, 720 were captured.

The placements of the viewing windows 714, 724 may provide punchouts ofthe images 710, 720 that are stable with respect to each other. Forexample, the field of view 712 and the field of view 722 may coverdifferent portions of the scene due to motion (e.g., panning, shaking)of the image capture device. The punchouts of the images 710, 720 usingthe viewing windows 714, 724 depict the same portion of the scene. Thepunchouts of the images 710, 720 using the viewing windows 714, 724 mayinclude overlapping portions of the field of view 712, 722.

The reference image and the background image may be stabilized such thatoverlapping portions of the fields of view of the two images arealigned. The alignment of the overlapping portions may result in pixelsdepicting the same portion of the scene within the reference image andthe background image being aligned. For example, the reference image 610and a background image 620 in FIG. 6 may have been stabilized such thatoverlapping portions of the fields of view of the two images arealigned. The reference image 610 and the background image 620 mayinclude punchout of overlapping portions of the captured visual content,so that the images appear to have been captured by a static imagecapture device.

The reference image and the background image may be stabilized such thatthe extent of the field of view of the background image that overlapswith the extent of the field of view of the reference image depictingthe object of interest includes depiction of background (rather than theobject of interest). That is, the stabilized reference image may includedepiction of the object of interest blocking the view of a particularportion of the scene/background, and the stabilized background image mayinclude depiction of the portion of the scene/background that wasblocked by the object of interest in the stabilized reference image.

For example, referring to FIG. 6, the reference image 610 and thebackground image 620 may be stabilized such that the extent of the fieldof view of the background image 620 that overlaps with the extent of thefield of view of the reference image 610 depicting the object ofinterest includes depiction of background (rather than the object ofinterest). That is, the reference image 610 may include depiction of theperson on the skateboard blocking the view of a part of light pole,building, and ground, and the background image 620 may include depictionof the part of the light pole, building, and ground that was blocked bythe person on the skateboard in the reference image. The backgroundimage 620 may provide information on what was behind the object ofinterest in the reference image 610.

The object layer component 110 may be configured to generate an objectlayer and/or other layers. An object layer may refer to an image layerincluding depiction of the object of interest. The object layer may begenerated to include the depiction of the object of interest based onsegmentation of the depiction of the object of interest from the visualcontent of the reference image. For example, the object layer may begenerated by segmenting the depiction of the person on the skateboardfrom the reference image 610. In some implementations, an object maskmay be created based on segmentation of the object of interest. FIG. 8illustrates an example object mask 800. The object mask 800 may begenerated based on object detection/segmentation 810 of the object ofinterest from the reference image. The object mask may include onecolor/pixel intensity for portion of the image/layer to be masked andanother color/pixel intensity for portion of the image/layer to not bemasked. The object mask may be used to differentiate extents ofimages/layers to blur and extents of images/layers to be kept sharp. Insome implementations, user input may control refinement (e.g.,modification, changes) of the object mask.

The background layer component 112 may be configured to generate abackground layer and/or other layers. A background layer may refer to animage layer including depiction of the background. The background layermay be generated to include the depiction of the background based oncombination of the depiction of the background within the visual contentof the background image with the visual content of the reference image.That is, the background layer may be generated by using the depiction ofthe background in both the background image and the reference image. Thebackground layer may be generated such that the depiction of the objectof interest is reduced in the background layer. Reducing the depictionof the object of interest in the background layer may include reducingthe visibility and/or the presence of the depiction of the object ofinterest in the background layer. In some implementations, reducing thedepiction of the object of interest in the background layer may includeeliminating the depiction of the object of interest in the backgroundlayer.

In some implementations, the depiction of the object of interest withinthe background layer may be reduced by merging the depiction of thebackground within the background image with the depiction of the objectof interest within the reference image. For example, the visual contentof the background image and the visual content of the reference imagemay be merged so that the extent of the reference image including thedepiction of the object of interest is merged with the extent of thebackground image including the depiction of the background. For example,the background image includes depiction of the background blocked by theobject of interest in the reference image, and the portion of thebackground image depicting the background blocked by the object ofinterest in the reference image is merged with the depiction of theobject of interest in the reference image to reduce the visibility ofthe object of interest. Depictions of the object of interest and thebackground may have the same or different opacity/transparency.

For example, FIG. 9 illustrates an example background layer 910. Thebackground layer 910 may be generated to include the depiction of thebackground based on combination of the depiction of the backgroundwithin the visual content of the background image 620 with the visualcontent of the reference image 610. For example, the visual content ofthe background image 620 and the visual content of the reference image610 may be merged so that the extent of the reference image 610including the depiction of the person on the skateboard is merged withextent of the background image 620 including the depiction of the partof the light pole, building, and ground that was blocked by the personon the skateboard in the reference image 610.

In some implementations, the depiction of the object of interest withinthe background layer may be reduced by replacing the depiction of theobject of interest within the reference image with the depiction of thebackground within the background image. For example, the visual contentof the background image and the visual content of the reference imagemay be selectively used so that the extent of the reference imageincluding the depiction of the object of interest is replaced with theextent of the background image including the depiction of thebackground. For example, the background image includes depiction of thebackground blocked by the object of interest in the reference image, andthe portion of the reference image including the depiction of the objectof interest is replaced with the portion of the background imagedepicting the background blocked by the object of interest in thereference image to reduce the visibility of the object of interest.

In some implementations, the background layer may be generated based onone or more masks, such as an object mask (e.g., the object mask 800).The portion of the reference image not masked by the object mask may befilled with corresponding pixels from the background image to generatethe background layer. For example, the object mask 800 may be used tomask depiction of background and to unmask depiction of the person onthe skateboard in the reference image 610. The depiction of the personon the skateboard in the reference image 610 filled with thecorresponding pixels from the background image 620 to generate thebackground layer 910. Other generation of background layer arecontemplated.

The blur component 114 may be configured to blur the background layerand/or other layers. Blurring the background layer may include makingthe background layer less distinct/less sharp. FIG. 9 illustrates anexample blurred background layer 920. The blurred background layer 920may be generated by blurring the background layer 910. One or moreparameters may control how and/or the extent to which the backgroundlayer is blurred. For example, the blur component 114 may utilizedifferent types of blurring techniques to produce different types ofblur effect within the background layer. The strength(s) with which thebackground layer is blurred may be controlled by one or more strengthparameters. Blur may be applied with same strength across the entirebackground layer or with different strengths for different portions ofthe background layer. The direction(s) in which the background layer isblurred may be controlled by one or more direction parameters. Blur maybe applied in the same direction across the entire background layer orin different directions for different portions of the background layer.

In some implementations, the background layer may be blurred based onthe motion experienced by the image capture device between capture ofthe reference image and the background image and/or other information.In some implementations, the direction(s) in the background layer isblurred may be determined based on the motion experienced by the imagecapture device between capture of the reference image and the backgroundimage and/or other information. For example, the background layer may beblurred based on the motion experienced by the image capture devicebetween capture of the reference image and the background image bycomputing one or more directional blur kernels based on the motionexperienced by the image capture device between capture of the referenceimage and the background image. For example, the directional blurkernels may be computed to follow, oppose, or be orthogonal to themotion experienced by the image capture device between capture of thereference image and the background image. The directional blur kernel(s)may be applied to the background layer to blur the background layer.Other determination of blur direction are contemplated.

In some implementations, strength(s) with which the background layer isblurred may be determined based on the motion experienced by the imagecapture device between capture of the reference image and the backgroundimage and/or other information. For example, the strength(s) of the blurto be applied to the background layer may be determined based on thedirection and/or speed of motion experienced by the image capturedevice. For example, the strength of the blur to be applied to thebackground layer may increase with faster speed and decrease with slowerspeed of the motion experienced by the image capture device betweencapture of the reference image and the background image and/or otherinformation. Other determination of blur strength are contemplated.

In some implementations, strength(s) and/or direction(s) in which thebackground layer is blurred may adjusted based on user input and/orother information. For example, a user may interact with a graphicaluser interface to set/change the strength(s) and/or direction(s) to beused in blurring the background layer.

(01) The panning image component 116 may be configured to generate apanning image based on combination of the object layer, the blurredbackground layer, and/or other layers. The object layer and the blurredbackground layer may be combined into a single panning image. In someimplementation, one or both of the object layer and the blurredbackground layer may be modified for combination into the panning image.For example, the edge/frontier of the depiction of the object ofinterest within the object layer may be blurred. The blurred edge of thedepiction of the object of interest within the object layer may beblended with the background layer to generate the panning image. Suchcombination of the object layer and the blurred background layer maymake smoother transition from the depiction of the object of interest tothe depiction of the background than simple combination of the objectlayer and the blurred background layer. Blurring the edge of thedepiction of the object of interest may also enable use of less accuratesegmentation for generate the object layer. That is, because the outeredges of the object of interest is blurred, inaccuracies in segmentationof the object of depiction from the reference image may not be evidentin the panning image.(02) FIG. 10 illustrates an example panning image 1000. The panningimage 1000 may be generated based on combination of the object layerincluding depiction of the person on skateboard and the blurredbackground layer 920. The edge of the person and the skateboard may beblurred and blended with the blurred background layer 920 to generatethe panning image 1000.(03) FIG. 11 illustrates an example panning image 1100. The panningimage 1100 may be generated by using different direction of blur fromthe direction of blur used to generate the panning image 1000. Forexample, the panning image 1000 may be generated by using a lateral(left-right) directional blur for the background layer, while thepanning image 1100 may be generated by using a slanted/vertical(up-down) direction blur for the background layer. For instance, thedirection of the blur for the panning image 1000 may be automaticallydetermined based on the motion experienced by the image capture devicebetween capture of the reference image and the background image, and thedirection of the blur for the panning image 1100 may be determined basedon user input to set/change the direction.

Implementations of the disclosure may be made in hardware, firmware,software, or any suitable combination thereof. Aspects of the disclosuremay be implemented as instructions stored on a machine-readable medium,which may be read and executed by one or more processors. Amachine-readable medium may include any mechanism for storing ortransmitting information in a form readable by a machine (e.g., acomputing device). For example, a tangible (non-transitory)machine-readable storage medium may include read-only memory, randomaccess memory, magnetic disk storage media, optical storage media, flashmemory devices, and others, and a machine-readable transmission mediamay include forms of propagated signals, such as carrier waves, infraredsignals, digital signals, and others. Firmware, software, routines, orinstructions may be described herein in terms of specific exemplaryaspects and implementations of the disclosure, and performing certainactions.

In some implementations, some or all of the functionalities attributedherein to the system 10 may be provided by external resources notincluded in the system 10. External resources may include hosts/sourcesof information, computing, and/or processing and/or other providers ofinformation, computing, and/or processing outside of the system 10.

Although the processor 11 and the electronic storage 13 are shown to beconnected to the interface 12 in FIG. 1, any communication medium may beused to facilitate interaction between any components of the system 10.One or more components of the system 10 may communicate with each otherthrough hard-wired communication, wireless communication, or both. Forexample, one or more components of the system 10 may communicate witheach other through a network. For example, the processor 11 maywirelessly communicate with the electronic storage 13. By way ofnon-limiting example, wireless communication may include one or more ofradio communication, Bluetooth communication, Wi-Fi communication,cellular communication, infrared communication, Li-Fi communication, orother wireless communication. Other types of communications arecontemplated by the present disclosure.

Although the processor 11 is shown in FIG. 1 as a single entity, this isfor illustrative purposes only. In some implementations, the processor11 may comprise a plurality of processing units. These processing unitsmay be physically located within the same device, or the processor 11may represent processing functionality of a plurality of devicesoperating in coordination. The processor 11 may be configured to executeone or more components by software; hardware; firmware; some combinationof software, hardware, and/or firmware; and/or other mechanisms forconfiguring processing capabilities on the processor 11.

It should be appreciated that although computer components areillustrated in FIG. 1 as being co-located within a single processingunit, in implementations in which processor 11 comprises multipleprocessing units, one or more of computer program components may belocated remotely from the other computer program components. Whilecomputer program components are described as performing or beingconfigured to perform operations, computer program components maycomprise instructions which may program processor 11 and/or system 10 toperform the operation.

While computer program components are described herein as beingimplemented via processor 11 through machine-readable instructions 100,this is merely for ease of reference and is not meant to be limiting. Insome implementations, one or more functions of computer programcomponents described herein may be implemented via hardware (e.g.,dedicated chip, field-programmable gate array) rather than software. Oneor more functions of computer program components described herein may besoftware-implemented, hardware-implemented, or software andhardware-implemented

The description of the functionality provided by the different computerprogram components described herein is for illustrative purposes, and isnot intended to be limiting, as any of computer program components mayprovide more or less functionality than is described. For example, oneor more of computer program components may be eliminated, and some orall of its functionality may be provided by other computer programcomponents. As another example, processor 11 may be configured toexecute one or more additional computer program components that mayperform some or all of the functionality attributed to one or more ofcomputer program components described herein.

The electronic storage media of the electronic storage 13 may beprovided integrally (i.e., substantially non-removable) with one or morecomponents of the system 10 and/or as removable storage that isconnectable to one or more components of the system 10 via, for example,a port (e.g., a USB port, a Firewire port, etc.) or a drive (e.g., adisk drive, etc.). The electronic storage 13 may include one or more ofoptically readable storage media (e.g., optical disks, etc.),magnetically readable storage media (e.g., magnetic tape, magnetic harddrive, floppy drive, etc.), electrical charge-based storage media (e.g.,EPROM, EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive,etc.), and/or other electronically readable storage media. Theelectronic storage 13 may be a separate component within the system 10,or the electronic storage 13 may be provided integrally with one or moreother components of the system 10 (e.g., the processor 11). Although theelectronic storage 13 is shown in FIG. 1 as a single entity, this is forillustrative purposes only. In some implementations, the electronicstorage 13 may comprise a plurality of storage units. These storageunits may be physically located within the same device, or theelectronic storage 13 may represent storage functionality of a pluralityof devices operating in coordination.

FIG. 2 illustrates method 200 for generating panning images. Theoperations of method 200 presented below are intended to beillustrative. In some implementations, method 200 may be accomplishedwith one or more additional operations not described, and/or without oneor more of the operations discussed. In some implementations, two ormore of the operations may occur substantially simultaneously.

In some implementations, method 200 may be implemented in one or moreprocessing devices (e.g., a digital processor, an analog processor, adigital circuit designed to process information, a central processingunit, a graphics processing unit, a microcontroller, an analog circuitdesigned to process information, a state machine, and/or othermechanisms for electronically processing information). The one or moreprocessing devices may include one or more devices executing some or allof the operation of method 200 in response to instructions storedelectronically on one or more electronic storage media. The one or moreprocessing devices may include one or more devices configured throughhardware, firmware, and/or software to be specifically designed forexecution of one or more of the operations of method 200.

Referring to FIG. 2 and method 200, at operation 201, visual informationmay be obtained. The visual information may define visual content ofimages captured by an image capture device while experiencing motion. Insome implementation, operation 201 may be performed by a processorcomponent the same as or similar to the visual information component 102(Shown in FIG. 1 and described herein).

At operation 202, motion information may be obtained. The motioninformation may characterize the motion experienced by the image capturedevice during capture of the images. In some implementation, operation202 may be performed by a processor component the same as or similar tothe motion information component 104 (Shown in FIG. 1 and describedherein).

At operation 203, a reference image may be selected from the images. Thevisual content of the reference image may have a first field of view ofa scene including an object of interest. The visual content of thereference image may include a depiction of the object of interestlocated at a first extent of the first field of view. In someimplementation, operation 203 may be performed by a processor componentthe same as or similar to the reference image component 106 (Shown inFIG. 1 and described herein).

At operation 204, a background image may be selected from the images.The background image may be different from the reference image. Thevisual content of the background image may have a second field of viewof the scene. The second field of view of the scene may be differentfrom the first field of view based on the motion experienced by theimage capture device between capture of the reference image and thebackground image. The reference image and the background image may bestabilized based on the motion experienced by the image capture devicebetween capture of the reference image and the background image and/orother information. The reference image and the background image may bestabilized such that overlapping portions of the first field of view andthe second field of view are aligned and a second extent of the secondfield of view that overlaps with the first extent of the first field ofview includes a depiction of background. In some implementation,operation 204 may be performed by a processor component the same as orsimilar to the background image component 108 (Shown in FIG. 1 anddescribed herein).

At operation 205, an object layer may be generated. The object layer mayinclude the depiction of the object of interest based on segmentation ofthe depiction of the object of interest from the visual content of thereference image. In some implementation, operation 205 may be performedby a processor component the same as or similar to the object layercomponent 110 (Shown in FIG. 1 and described herein).

At operation 206, a background layer may be generated based oncombination of the depiction of the background within the visual contentof the background image with the visual content of the reference imagesuch that the depiction of the object of interest is reduced in thebackground layer. In some implementation, operation 206 may be performedby a processor component the same as or similar to the background layercomponent 112 (Shown in FIG. 1 and described herein).

At operation 207, the background layer may be blurred. In someimplementation, operation 207 may be performed by a processor componentthe same as or similar to the blur component 114 (Shown in FIG. 1 anddescribed herein).

At operation 208, a panning image may be generated based on combinationof the object layer and the blurred background layer. In someimplementation, operation 208 may be performed by a processor componentthe same as or similar to the panning image component 116 (Shown in FIG.1 and described herein).

Although the system(s) and/or method(s) of this disclosure have beendescribed in detail for the purpose of illustration based on what iscurrently considered to be the most practical and preferredimplementations, it is to be understood that such detail is solely forthat purpose and that the disclosure is not limited to the disclosedimplementations, but, on the contrary, is intended to covermodifications and equivalent arrangements that are within the spirit andscope of the appended claims. For example, it is to be understood thatthe present disclosure contemplates that, to the extent possible, one ormore features of any implementation can be combined with one or morefeatures of any other implementation.

What is claimed is:
 1. A system that generates panning images, thesystem comprising: one or more physical processors configured bymachine-readable instructions to: obtain visual information, the visualinformation defining visual content of images captured by an imagecapture device while experiencing motion; obtain motion information, themotion information characterizing the motion experienced by the imagecapture device during capture of the images; select a reference imagefrom the images, the visual content of the reference image having afirst field of view of a scene including an object of interest, thevisual content of the reference image including a depiction of theobject of interest located at a first extent of the first field of view;select a background image from the images, the background imagedifferent from the reference image, the visual content of the backgroundimage having a second field of view of the scene different from thefirst field of view based on the motion experienced by the image capturedevice between capture of the reference image and the background image,wherein the reference image and the background image are stabilizedbased on the motion experienced by the image capture device betweencapture of the reference image and the background image such thatoverlapping portions of the first field of view and the second field ofview are aligned and a second extent of the second field of viewoverlapping with the first extent of the first field of view includes adepiction of background; generate an object layer including thedepiction of the object of interest based on segmentation of thedepiction of the object of interest from the visual content of thereference image; generate a background layer based on combination of thedepiction of the background within the visual content of the backgroundimage with the visual content of the reference image such that thedepiction of the object of interest is reduced in the background layer;blur the background layer; and generate a panning image based oncombination of the object layer and the blurred background layer.
 2. Thesystem of claim 1, wherein the depiction of the object of interest isreduced by merging the depiction of the background with the depiction ofthe object of interest.
 3. The system of claim 1, wherein the depictionof the object of interest is reduced by replacing the depiction of theobject of interest with the depiction of the background.
 4. The systemof claim 1, wherein the background layer is blurred based on the motionexperienced by the image capture device between capture of the referenceimage and the background image.
 5. The system of claim 4, whereinblurring of the background layer based on the motion experienced by theimage capture device between capture of the reference image and thebackground image includes: computing a directional blur kernel thatfollows the motion experienced by the image capture device betweencapture of the reference image and the background image; and applyingthe directional blur kernel to the background layer.
 6. The system ofclaim 5, wherein strength with which the background layer is blurred isdetermined based on the motion experienced by the image capture devicebetween capture of the reference image and the background image.
 7. Thesystem of claim 1, wherein the motion experienced by the image capturedevice includes rotation of the image capture device to follow motion ofthe object of interest.
 8. The system of claim 1, wherein the backgroundimage includes one of the images captured before or after the referenceimage.
 9. The system of claim 1, wherein generating the panning imagebased on the combination of the object layer and the blurred backgroundlayer includes: blurring edge of the depiction of the object of interestwithin the object layer; and blending the blurred edge of the depictionof the object of interest within the object layer with the backgroundlayer.
 10. The system of claim 1, wherein strength and direction inwhich the background layer is blurred is adjusted based on user input.11. A method for generating panning images, the method performed by acomputing system including one or more processors, the methodcomprising: obtaining, by the computing system, visual information, thevisual information defining visual content of images captured by animage capture device while experiencing motion; obtaining, by thecomputing system, motion information, the motion informationcharacterizing the motion experienced by the image capture device duringcapture of the images; selecting, by the computing system, a referenceimage from the images, the visual content of the reference image havinga first field of view of a scene including an object of interest, thevisual content of the reference image including a depiction of theobject of interest located at a first extent of the first field of view;selecting, by the computing system, a background image from the images,the background image different from the reference image, the visualcontent of the background image having a second field of view of thescene different from the first field of view based on the motionexperienced by the image capture device between capture of the referenceimage and the background image, wherein the reference image and thebackground image are stabilized based on the motion experienced by theimage capture device between capture of the reference image and thebackground image such that overlapping portions of the first field ofview and the second field of view are aligned and a second extent of thesecond field of view overlapping with the first extent of the firstfield of view includes a depiction of background; generating, by thecomputing system, an object layer including the depiction of the objectof interest based on segmentation of the depiction of the object ofinterest from the visual content of the reference image; generating, bythe computing system, a background layer based on combination of thedepiction of the background within the visual content of the backgroundimage with the visual content of the reference image such that thedepiction of the object of interest is reduced in the background layer;blurring, by the computing system, the background layer; and generating,by the computing system, a panning image based on combination of theobject layer and the blurred background layer.
 12. The method of claim11, wherein the depiction of the object of interest is reduced bymerging the depiction of the background with the depiction of the objectof interest.
 13. The method of claim 11, wherein the depiction of theobject of interest is reduced by replacing the depiction of the objectof interest with the depiction of the background.
 14. The method ofclaim 11, wherein the background layer is blurred based on the motionexperienced by the image capture device between capture of the referenceimage and the background image.
 15. The method of claim 14, whereinblurring of the background layer based on the motion experienced by theimage capture device between capture of the reference image and thebackground image includes: computing a directional blur kernel thatfollows the motion experienced by the image capture device betweencapture of the reference image and the background image; and applyingthe directional blur kernel to the background layer.
 16. The method ofclaim 15, wherein strength with which the background layer is blurred isdetermined based on the motion experienced by the image capture devicebetween capture of the reference image and the background image.
 17. Themethod of claim 11, wherein the motion experienced by the image capturedevice includes rotation of the image capture device to follow motion ofthe object of interest.
 18. The method of claim 11, wherein thebackground image includes one of the images captured before or after thereference image.
 19. The method of claim 11, wherein generating thepanning image based on the combination of the object layer and theblurred background layer includes: blurring edge of the depiction of theobject of interest within the object layer; and blending the blurrededge of the depiction of the object of interest within the object layerwith the background layer.
 20. The method of claim 11, wherein strengthand direction in which the background layer is blurred is adjusted basedon user input.